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Description 



SYSTEM AND METHOD FOR REAL-TIME 
PROCESSING AND DISPLAY OF DIGITAL 
MEDICAL IMAGES 

Background of the Invention 

[0001] The present disclosure relates generally to processing of 
imaging system data and, more particularly, to a system 
and method for processing medical images in real time 
using a commercially available, off the shelf processor(s). 

[0002] Medical diagnostic and imaging systems are ubiquitous in 
modern health care facilities. Such systems provide in- 
valuable tools for identifying, diagnosing and treating 
physical conditions and greatly reduce the need for surgi- 
cal diagnostic intervention. In many instances, final diag- 
nosis and treatment proceed only after an attending 
physician or radiologist has complemented conventional 
examinations with detailed images of relevant areas and 
tissues via one or more imaging modalities. 

[0003] Currently, a number of modalities exist for medical diag- 



nostic and imaging systems. Tliese include computed to- 
mograpliy (CT) systems, x-ray systems (including both 
conventional and digital or digitized imaging systems), 
magnetic resonance (MR) systems, positron emission to- 
mography (PET) systems, ultrasound systems and nuclear 
medicine systems. In many instances, these modalities 
complement one another and offer the physician a range 
of techniques for imaging particular types of tissue, or- 
gans, physiological systems, and so forth. Health care in- 
stitutions often dispose of several such imaging systems 
at a single or multiple facilities, permitting its physicians 
to draw upon such resources as required particular patient 
needs. 

[0004] Modern medical diagnostic systems typically include cir- 
cuitry for acquiring image data and for transforming the 
data into a useable form, which is then processed to cre- 
ate a reconstructed image of features of interest within 
the patient. The image data acquisition and processing 
circuitry is often referred to as a "scanner" regardless of 
the modality, because some sort of physical or electronic 
scanning often occurs in the imaging process. The partic- 
ular components of the system and related circuitry, of 
course, differ greatly between modalities due to their dif- 



ferent physics and data processing requirements. 
[0005] For example, radiograpliy is tlie teclinique of producing 
an image of any opaque specimen by the penetration of 
radiation, such as gamma rays, x-rays, neutrons, or 
charged particles, for example. When a beam of radiation 
is transmitted through any heterogeneous object, the ra- 
diation is differentially absorbed depending upon varying 
object thickness, density, and chemical composition. The 
emerging energy from the object forms a radiographic 
image, which may then be realized on an image detection 
medium, such as a radiation sensitive detector having an 
array of elements that generate a signal output depending 
on the level of radiation absorbed, the detector signal 
output being converted into a voltage for exciting display 
pixels. As radiography is a non-destructive technique for 
testing the gross internal structure of an object, it is con- 
ventionally used in both medical and industrial applica- 
tions. More specifically, radiography is used to detect 
medical conditions such as tuberculosis and bone frac- 
tures, as well as to non-destructively detect manufactur- 
ing imperfections in materials such as cracks, voids, and 
porosity. 

[0006] Regardless of the imaging modality, the conventional pro- 



cessing techniques are generally implemented with appli- 
cation specific processors that are configured for specific 
system components. This design makes such processing 
systems expensive to purchase and operate. Accordingly, 
it is desirable to be able to process data from medical 
imaging systems at a lower cost such as through com- 
mercial off the shelf hardware and/or software. 
Brief Description of the Invention 

[0007] jhe above discussed and other drawbacks and deficien- 
cies of the prior art are overcome or alleviated by a 
method of processing image data of a scanned object. In 
an exemplary embodiment, the method includes perform- 
ing, in integer format, a pixel offset correction on the im- 
age data using unsigned saturation arithmetic to produce 
an image in integer format having negative value pixels 
clipped to a value of zero. The resulting pixels are con- 
verted to floating point format and are multiplied by a 
positive floating point gain factor. The resulting pixels are 
further converted to integer format and clamped to a 
maximum value using saturation arithmetic. Non- 
functional pixel correction is performed in integer format, 
and the resulting pixel values are clamped to a maximum 
value using saturation arithmetic. The resulting pixel 



value is mapped in integer format to a palette index using 
a lookup table to establish an output pixel intensity hav- 
ing one of a plurality of intensity levels. 
[0008] In another aspect, a computer program article for pro- 
cessing image data of scanned object includes a storage 
medium, readable by a commercial off the shelf process- 
ing circuit. The storage medium includes instructions for 
execution by the processing circuit for performing, in in- 
teger format, a pixel offset correction on the image data 
using a dark image subtraction and saturation arithmetic 
to produce an image in integer format having negative 
value pixels clipped to a value of zero. The resulting pix- 
els are converted to floating point format and are multi- 
plied by a positive floating point gain factor. The resulting 
pixels are further converted to integer format and 
clamped to a maximum value using saturation arithmetic. 
Non-functional pixel correction is performed in integer 
format, and the resulting pixel values are clamped to a 
maximum value using saturation arithmetic. The resulting 
pixel value is mapped in integer format to a palette index 
using a lookup table to establish an output pixel intensity 
having one of a plurality of intensity levels. The mapped 
image data is filtered to enhance feature recognition 



within tlie thiclcness range of the scanned object, and the 
filtered image data is displayed in real-time at a frame 
rate of equal to or greater than 30 million pixels per sec- 
ond. 

[0009] In still another aspect, a medical imaging system includes 
an image device adapted to acquire and output image 
data, an imaging system controller in communication with 
the image device, the imaging system controller config- 
ured to receive commands from a computer, and a display 
device for displaying the image data. The computer fur- 
ther includes a processor programmed for performing, in 
integer format, a pixel offset correction on the image data 
using a dark image subtraction and saturation arithmetic 
to produce an image in integer format having negative 
value pixels clipped to a value of zero. The resulting pix- 
els are converted to floating point format and are multi- 
plied by a positive floating point gain factor. The resulting 
pixels are further converted to integer format and 
clamped to a maximum value using saturation arithmetic. 
Non-functional pixel correction is performed in integer 
format, and the resulting pixel values are clamped to a 
maximum value using saturation arithmetic. The mapped 
image data is filtered to enhance feature recognition 



within tlie tliiclcness range of tlie scanned object. Tlie re- 
sulting pixel value is mapped in integer format to a 
palette index using a lookup table to establish an output 
pixel intensity having one of a plurality of intensity levels, 
and the filtered image data is displayed in real-time at a 
frame rate of equal to or greater than 30 million pixels 
per second on the display device. 
Brief Description of the Drawings 

[0010] Referring to the exemplary drawings wherein like ele- 
ments are numbered alike in the several Figures: 

[0011] Figure 1 is an exemplary medical imaging system suitable 
for implementing an embodiment of the invention; and 

[0012] Figure 2 is an exemplary flow diagram for processing im- 
age data using commercial off the shelf hardware /soft- 
ware in accordance with an embodiment of the present 
invention. 
Detailed Description of the Invention 

[0013] Disclosed herein is a medical imaging system and method 
that dynamically processes obtained images in real-time 
using a plurality of one or more commercial off the shelf 
(COTS) processors having native saturation arithmetic ca- 
pability. Saturation arithmetic refers to a known processor 



characteristic wliere calculations are clipped to a preset 
range. The specific nature of the clipping depends on 
whether one performs signed or unsigned arithmetic. 
Signed saturated subtraction clips the result to the largest 
negative value that the bit-depth can support, whereas 
unsigned saturated subtraction clips the result to zero. 
Furthermore, saturated addition clips the result to the 
largest positive value that the bit depth can support. For a 
given bit depth, numerical range depends on whether a 
quantity is treated as a signed or unsigned value. 

[0014] While the embodiments described herein depict x-rays 
generated in a radiographic imaging system as an exem- 
plary type of radiation for radiographic imaging, it will be 
appreciated that the present invention is also applicable to 
other radiation types, such as gamma rays, high- 
frequency sound waves, magnetic fields, neutrons, or 
charged particles for example. Furthermore, it also appli- 
cable to other medical imaging modalities (e.g., CT, MR!, 
PET), as well as non-medical imaging uses. 

[0015] Referring initially to Figure 1, there is shown an exemplary 
embodiment of a radiographic inspection system 100 that 
includes a computer 102 adapted to be in signal commu- 
nication with a medical imaging system 104 via a commu- 



nication bus 106. The imaging system 104 is adapted to 
acquire and output radiograpliic image data of a scanned 
object 108 (e.g., a patient) via an imaging device 110, 
which includes an x-ray source 112 and image detector 
114. The imaging system 104 also includes an imaging 
system controller 116 that receives control commands 
from computer 102 and sends control signals to the vari- 
ous components of imaging device 110. 
[0016] The computer 102 includes one or more processors 118, 
120 to execute operations according to a set of instruc- 
tions provided by installed application software (discussed 
in further detail hereinafter), a detector interface card 122 
(also discussed in further detail hereinafter), at least one 
memory 124 to store the application software and to store 
the image data received from image detector 114, an in- 
put device 126, and a display device 128. The memory 
124 refers to any type and number of memory chips, 
magnetic storage disks, optical storage disks, mass stor- 
age devices, or any other storage device suitable for re- 
taining information. The input device 126 may be, for ex- 
ample, a keyboard, a mouse, a pointing device, a touch 
sensitive screen device, a tablet, a read/write drive for a 
magnetic disk, a read/write drive for an optical disk, a 



read/write drive for any other input medium, an input port 
for a communication linl< (electrical or optical), a wireless 
receiver, or any combination thereof. 
[0017] In addition, the display device 128 may be a CRT (cathode 
ray tube) screen or any other suitable display device for 
displaying text, graphics, and a graphical user interface, 
for example. The detector interface card 122 provides low 
level control over the image detector, buffers data read 
out from the image detector, and optionally reorders im- 
age pixels to convert from read-out order to display or- 
der. 

[0018] In exemplary embodiments, the processors 118, 120 are a 
1.7 GHz or faster Intel Pentium 4 processor and a 2.4 GHZ 
or faster Intel Xeon processor, respectively, that are pro- 
grammed to process image data (e.g., radiographic) of 
scanned object 108 according to a process 200 depicted 
in Figure 2. As shown in Figure 2, process 200 begins at 
block 202 by performing in 16-bit integer format a pixel 
offset correction on the 16-bit radiographic image using 
native saturation arithmetic to produce an image in 16-bit 
integer format having negative value pixels clipped to a 
value of zero. In one embodiment, the pixel offset correc- 
tion involves subtracting dark image (alternatively offset 



image) pixel values from the radiographic image pixel val- 
ues, where dark image refers to an image data set ac- 
quired in the absence of x-rays and stored at memory 
124. As used herein, reference to an operation on a pixel 
means an operation on the intensity value of the pixel. 
When system 100 is operating in real-time mode, the 
16-bit radiographic images are continuously acquired at 
imaging device 110, processed by one or more processors 
118, 120, and displayed at display 128 at a frame rate 
equivalent to 30 million pixels per second. 

[0019] At blocks 204-206, the processor(s) 118, 120 converts 
the offset corrected image data to a 32-bit floating point 
number, and multiplies the converted pixels by a 32-bit 
positive floating point gain factor acquired from a nor- 
malization look up table within memory 124. Optionally, 
this product is weighted with a previously computed 
product to temporally integrate the noise inherent in the 
detector. The resulting floating point product is converted 
to a 16-bit integer value using saturation arithmetic. 

[0020] Native saturation arithmetic also clamps the 16-bit inte- 
gers to the maximum value available in 16-bit integer 
format and to a minimum value of zero, thereby estab- 
lishing a pixel saturation value that eliminates visual arti- 



facts in the display. Tlie clamped pixel values are clamped 
to an appropriate 16-bit range and not allowed to wrap. 
In a preferred embodiment, the operations described in 
block 202-206 are performed in their entirety on a suit- 
ably defined small number/group of pixels (over multiple 
iterations) in order to maximize cache performance. The 
specific number of pixels used in the operations of offset 
subtraction, gain normalization, optional temporal aver- 
aging, and conversion back to integer are optimized ac- 
cording to the size of the cache line supported by the 
processor. 

[0021] At block 208, processor(s) 118, 120 performs in 16-bit 
integer format a non-functional pixel correction by re- 
placing a non-functional pixel with the average pixel in- 
tensity value of the neighboring pixels. Other non- 
functional pixel correction routines may be employed in 
place of the "average-of-the-neighbors" routine. In one 
embodiment, a non-functioning pixel is identified during 
system calibration. The corrected image is then processed 
using native saturation arithmetic to clamp the pixel val- 
ues to the maximum value available in 16-bit integer for- 
mat. The user may in real-time adjust the number of 
frames that the linear averaging is applied to, thereby ob- 



taining a visually optimal display. 
[0022] At block 210, the resulting 16-bit corrected pixel value is 
mapped to display resolution in integer format to an 8-bit 
palette index via a lookup table at memory 124 to estab- 
lish an output pixel intensity having one of a plurality 
(such as l-of-256, for example) of intensity levels, which 
in may be displayed as shades of gray. In one embodi- 
ment, a single lookup table incorporating both contrast 
management and gamma correction is used to map the 
integer resulting pixel to an 8 bit gray scale image suit- 
able for display on a standard monitor. Contrast manage- 
ment can include window/level, histogram equalization, 
or any other standard image processing technique. Com- 
bining the contrast management with the gamma correc- 
tion avoids the posterization effect produced by using two 
separate lookup tables. Posterization is a known phenom- 
ena in which tiny rectangular regions due to truncation 
are visible in an image. Finally, as shown in block 212, the 
resulting image is displayed at a real-time frame rate of 
equal to or greater than an equivalent of 30 million pixels 
per second. 

[0023] The above described process 200 may be embodied in a 
computer program article 130 (shown in Figure 1), such 



as for example a compact disc read-only-memory 
(CD-ROM), a writeable CD, a rewriteable CD, or any other 
suitable storage medium that Includes program Instruc- 
tions readable by a COTS processor. 
[0024] While the invention has been described with reference to a 
preferred embodiment. It will be understood by those 
skilled In the art that various changes may be made and 
equivalents may be substituted for elements thereof with- 
out departing from the scope of the Invention. In addition, 
many modifications may be made to adapt a particular 
situation or material to the teachings of the Invention 
without departing from the essential scope thereof. 
Therefore, It Is Intended that the Invention not be limited 
to the particular embodiment disclosed as the best mode 
contemplated for carrying out this invention, but that the 
invention will Include all embodiments falling within the 
scope of the appended claims. 



